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(54) Forward error correction at MPEG-2 transport stream layer 



(57) The invention is for a system and method for 
performing fonvard error correction on an MPEG-2 
transport stream that has optional error correction infor- 
mation embedded within the transport stream. An error 
correction operation is performed on a super group of 
packets within the transport stream. The error correction 
data is inserted into a created trailer group of MPEG-2 
compliant transport stream packets having no payload, 



but only an adaptation field The trailer group packets 
are optional and therefore can be discarded by a stand- 
ard MPEG-2 decoder, but can also be used to recover 
data lost in the transmission of the transport stream. The 
invention results in a system and method to con-ect an 
MPEG-2 transport stream that can be used in any one 
of the digital video broadcast (DVB) formats, without the 
need for error correction decoders which are specific to 
the DVB fonnat. 
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Description 

Field of the Invention 

[0001] This invention relates to techniques of fonward error correction with a communications protocol, and in par- 
ticular, relates to fonrard error correction of MPEG-2 at the transport stream layer. 

Background of the Invention 

[00021 Digital video includes the steps of the encoding of moving pictures into a digital signal, broadcasting the digitel 
signal and decoding the digital signal into a viewable format such as a television screen or a computer monrtor. With 
the rapid improvements in computer technology, digital video is now readily available for computer systems, etc. and 
will soon be widely available for broadcasting. As digital video can also incorporate the transmission of audio signals, 
it is believed that this technology will eventually replace current television technology (analog video), and will have 
broad application in many areas such as the Internet and telecommunications in general. 

[00031 Because of the broad application of digital video, the Intemational Organization For StandardiMton (ISO) 
formed ISO/IEC JTCI SC29 WG11. more commonly known as the Motion Pictures Expert Group 2 (MPEG-2) to gen- 
erate standards for broadcast quality digital video. (An eartier committee was ISO CD 11172. or MPEG-1 . whic^ 

the first generation of digital vWeo standarts. which are optimised for CD-ROM. Another ^^"f * ""^^^^^^^^'^PX 
is MPEG^ for low bandwidth video telephony.) In particular. MPEG-2 defines a compressed bit stream, but me actual 
implementation of the compression operations are up to individual manufacturers of digital video ^^'P^^ 
[0004] MPEG-2 is a standard rMPEG-2 standard") with various parts at different levels of completion. Of particular 

interest are: 

ISO/IEC DIS 13818-1 Infonnation technology - 

Generic coding of moving pictures and associated audio infonnation: 
Systems 

ISO/IEC DIS 13818-2 Information technology - 

Generic coding of moving pictures and associated audio infonnation: 
Video 

ISO/IEC 13818-3:1995 Information technology - 

Generic coding of nraving pictures and associated audio infonnation - 
Part 3: Audio 

and the contents of each of these references are incoipoiated herein by reference. The MPEG-2 standard addresses 
the combining of one or more elementary streams of video, audio and other data into single or multiple streams which 
are suitable for storage or transmission. In very general terms, the MPEG-2 standard for transmitting digital video and 
associated audio and other information involves the following steps: first, a digital video signal (from a digite camera 
or from an analog to digital converter) is compressed by analyzing and encoding the signal using spatial and temporal 
redundancy. Spatial redundancy refers to the redundant infom^ation inside one video frame while temporal redundancy 
refers to the redundant information between consecutive frames. This process generates: Intra-frames (1-frames). 
which contain all of the infomiation in an entire image; Predicted frames (P-Frames). which have ^me ^ni-P^J"" 
as they are predicted based on past l-frames and/or other P-frames; and Bi^lirectional predicted frames (B-frames). 
which are the most compressed images as they are predicted from past and future l-Frames and P-Fra-nes. Ne>d. an 
audio signal is compressed by removing low power tones adjacent high power tones. Removal of these tones does 
not affect the signal, because the high power tones tend to mask the lower power tones, making them inaudible to he 
human ear. Finally, the compressed video signals, audto signals and related time stamps of those signals are assembled 
into packets and inserted into a Packetized Elementary Stream (PES). Each packet in a packetized elementary sbeam 
contains overhead information such as a start code, stream id. packet length, optional packetized elementary stream 
header and stuffing bytes, in addition to the actual packet bytes of video and audio data. 

rooOSl It will be apparent from the foregoing that the packetized elementary stream contains encoded video and 
audio data for storage or transmission. In order to multiplex several streams of packetized elementaiy streams a 
Programme Specific Information (PSI) table Is also created, which includes a series of tables to reassemble specific 
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packetized elementary stream within multiple channels of packetized elementary streams. Thus, the packetized ele- 
mentary stream and program specific information form the basis for constmcting either a Program Stream (PS) or a 
Transport Stream (TS) of packetized elementary stream and program specific information packets, which are particu- 
larly defined in ISO/IEC Intematlonal Standard 13818-1. 

5 [0006] The Program Stream is generally suitable for communicating or storing one program of coded data and other 
data in error free environments, such as an optical storage device, and where processing of system coding is a major 
consideration. In contrast, the Transport Stream is suitable for storing or communicating one or more programs in 
environments where significant errors can occur, such as packet-switched networks, etc. These errors can be mani- 
fested as bit value errors within a packet, or the loss of one or more entire packets. 

10 [0007] However, while the transport stream was intended to protect data within the transport stream from corruption 
in error-prone environments, the transport stream has been found to be less than satisfactory in this regard and it 
remains difficult to ensure reliable transmission of the transport stream through these environments. These difficulties 
are more particularty explained in "Protecting MPEG-2 : FEC schemes in DVB-C,S,T", ("Protecting ^4PEG-2") © Cop- 
yright 1994-1998 Hewlett-Packard Company, the contents of which are incorporated herein by reference, and a copy 

15 of which Is available at: 

[0008] http://www.tmo.hp.com/tmo/pia/component_tes/PIAApp/Notes/English/MPEGpaper2.html. An example of 
error prone environments in which the transport stream can be broadcast are the various Digital Video Broadcasting 
Project (DVB) formats, such as Direct Broadcast Satellite (DBS), terrestrial cable networks (including coax and fibre 
optic etc.) or terrestrial broadcasts. In order to protect the transport stream and to achieve a Bit Error Ratio (BER) of 

20 no more than 10-^^, Forward Ent>r Correction (FEC) is now often added to protect the transport stream during trans- 
mission. In simple terms, the method of correcting in these formats is as follows: the original transport stream is inserted 
into a forward en-or correction encoder; the resulting signal is broadcast over the environment to a receiver; and the 
transport stream is recovered from the received signal by a symmetric forward error correction decoder 
[0009] Generally, a different forward error correction encoder and decoder is required for each DVB format, and this 

25 requires that each receiver have a symmetric forward error correction decoder. Variations between forward error cor- 
rection encoding techniques, such as Reed-Solomon (RS) , include the actual amount of error correction code added 
to the end each transport stream packet, whether the forward error correction packets are interieaved or spliced, and 
whether viterbi convolutional coding is pertormed. In addition to the necessity of a symmetric fonvard error correction 
decoder, it will be apparent that the addition of error correction code to the end of each packet effectively adds another 

30 layer to the protocol stack and this new layer is specific to the transmission architecture and not subject to the MPEG- 
2 standard. Thus, a broadcaster must ensure that each intended receiver has a symmetric forward error correction 
decoder. 



Summary of the Invention 

35 

[001 0] It is an object of the present invention to provide a novel fonward error correction method and system to protect 
a digital transport stream which obviates or mitigates at least one of the disadvantages of the prior art. 
[0011] In a first aspect of the present invention, there is provided a method of creating a portion of an enhanced 
MPEG compatible data stream with optional forward error correction information included therein, the method com- 
40 prising the steps of: 

receiving an MPEG data stream of data packets from an MPEG data stream source; 
forming a super group including a predefined number of the data packets; 

performing a selected forward error correcting operation on the super group of packets to obtain error correction 
<5 data; 

creating index data which relates the error correction data to one or more corresponding super group data packets; 
creating a trailer group including a sufficient number of MPEG compliant packets to accommodate the error cor- 
rection data and the index data, the trailer group further including code to identify each packet as optional; 
arranging the error correction data and the index data into the trailer group; and, 
50 assembling the MPEG compatible data stream with at least one super group followed by at least one trailer group 

corresponding with the at least one super group. 

[0012] In particular, the assembly according to the method of the first aspect comprises two super groups followed 
by two corresponding trailer groups. 
55 [001 3] Altemately, the assembly according to the method of the first aspect comprises the super group followed by 
a predefined number of null packets and is then followed the trailer group. Typically, the predefined number is equivalent 
to an estimated maximum burst error of the broadcast environment. 

[0014] Typically, the data stream according to the first aspect is an MPEG-2 transport stream; the super group com- 
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prises two-hundred-and-forty-sbc data pacRets: the trailer group^^^^^^^^^ 

Lection operation is Reed Solomon codir^. It is generaHy ^^^^'^^^'^'^^T^eferet^e V^i each 

^e^^iK rs:c:; srs -es . 

packet idertifier different from the super group paclcet 'dentifiers. ^p^^ 

SJ.rda^::i^.^^s:^5r:r^:^^^^^ 

receiving an MPEG data stream of data packets from an MPEG data ^J^"^- 

creating at least one MPEG a.mpatible packet with no ,„ of the received 

creating an unused portion of each packet received by ^►'■""^^ ^^"^^^^ ^^^^^^^ compatible packets 

packets into the at least one created MPEG compatible packet, the created at least one ivif- tv^ y 

^JcSlTg^^Jr^ernedCi error correcting operation on the payload data of each packet from the previous 
2:^1:: the" rr^^o^S in" thf unused ponions so as to intedeave t^ err. c^c*ion data w«h the 
payload data. 

10016] Typically, the data stream in the second aspect is an MPEG-2 transport stream. It is also generally preferred 
that the forward error correction operation is Reed Solomon coding. enhanced 

of: 

receiving an MPEG data stream of data packets from an MPEG data stream source; 
beina reinserted into the MPEG data stream being received in the first step; 

emtidding an identifier within the unused portion of the ^ obtain error correctton 

performing a selected fbrorard error correcting operation on the super group of pacKeis 

?Sng index data which relates the error correction data to one or more corresponding subgroup data packets 
in relation to the embedded identifiers; ^„„iiant nackets to accommodate the error cor- 

corresponding with the at least one super group, 
formed on parallel bytes of each packet within the super group. 

of: 

receiving an MPEG data stream of data packets from an MPEG data stream source: 
forming a super group comprising a predefined number of packets; 
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the MPEG data stream being received in the first step; 

emt>edding an identifier within the unused portion of each of the super group packets; 

performing a selected fonvard error correcting operation on the super group of packets to obtain error correction 

data; 

5 creating index data which relates the error correction data to one or more corresponding super group data packets 

in relation to the embedded identifiers; 

creating a trailer group including a sufficient number of MPEG compliant packets to accommodate the error cor- 
rection data and the Index data, the trailer group further including code to identify each packet as optional; 
arranging the error correction data and the index data into the trailer group; and, 
10 assembling the MPEG compatible data stream with at least one super group followed by at least one trailer group 

corresponding with the at least one super group. 

[0021] In particular, the assembly according to the method of the fourth aspect comprises two super groups followed 
by two corresponding trailer groups. 
IS [0022] Alternately, the assembly according to the method of the first aspect comprises the super group followed by 
a predefined number of null packets and is then foDowed the trailer group. Typically, the predefined number is equivalent 
to an estimated maximum burst error of the broadcast environment. 

[0023] Typically, the data stream in the fourth aspect is an MPEG-2 transport stream, the super group comprises 
two-hundred-and-forty-six data packets, the trailer group comprises eleven data packets, the forward error correction 
20 operation is Reed Solomon coding and the error correction operation is performed on parallel bytes of each packet 
within the super group. 

[0024] It is also typical in the method of the fourth aspect that each of the packets in the super group include a packet 
identifier and each of the packets in the trailer group include a packet identifier different from the super group packet 
identifiers. 

25 [0025] In a fifth aspect of the present invention, there is provided a method of transmitting data as an enhanced 
MPEG compatible data stream with optional forward error correction information included therein, the method com- 
prising the steps of: 

receiving an MPEG data stream of data packets from an MPEG data stream source; 
30 forming a super group including a predefined number of the data packets; 

performing a selected fonvard error correcting operation on the super group of packets to obtain error correction 
data; 

creating index data which relates the error correction data to one or more corresponding super group data packets; 
creating a trailer group including a sufficient number of MPEG compliant packets to accommodate the error cor- 
35 rection data and the index data, the trailer group further including code to identify each packet as optional; 

arranging the error correction data and the index data into the trailer group; 

assembling the enhanced MPEG compatible data stream with at least one super group followed by at least one 
trailer group corresponding with the at least one super group; 
broadcasting the enhanced MPEG compatible data stream; 
40 receiving the enhanced MPEG compatible data stream; 

extracting at least one received super group and at least one received trailer group corresponding to the at least 
one received super group from the data stream received in the previous step; and 

performing an error recovery operation on the at least one received super group using the error correction data in 
the at least one corresponding received trailer group. 

45 

[0026] Typically, the data stream of the fifth aspect is an MPEG-2 transport stream, the fonvard error correction 
operation is Reed Solomon coding, and the error correction operation is performed on parallel bytes of each packet 
within the super group. 

[0027] It Is also typical in the method of the fifth aspect that each of the packets In the super group include a packet 
50 identifier and each of the packets in the trailer group include a packet identifier different from the super group packet 
identifiers. 

[0028] In a sixth aspect of the invention, there is provided a method of recovering a portion of an enhanced MPEG 
compatible data stream of data packets having super groups of data packets and corresponding trailer groups of 
optional packets having forward error correction information and indexing information included therein, comprising the 
55 steps of: 

receiving the enhanced MPEG compatible data stream; 

extracting at least one received super group and at least one received trailer group corresponding to the at least 
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one received super group from the ^^^^^^ g,^,p .sing the error correction data in 

performing an error recovery operation on the at least one receivea super giuup ^ 

the at least one con-esponding received trailer group; 



is Reed Solomon decoding. ,^a,*uotc in the suoer arouD include a packet 

foSnn a seventh aspect of the invention, there is provided a system for creating a portion of an enhanced MPEG 
Sitible dai sram with optional forward error correction information included there.n. compns.ng. 

a receiver for receiving an I^PEG data stream of data packets from an ^PEG date^am 

?oLed by at least one trailer group corresponding with the at least one super group, and 
a transmitter for transmitting the enhanced MPEG compatible data stream. 

error correction data in the at least one corresponding received trailer group; and. 
a transmitter for transmitting said recovered super group to an MPEG end-user. 

with optional forward error correction infomiation included therein, composing: 

further including code to identify each paclcet as optional; „™rerfion data being obtained from 

«mr correction data embedded within the at least one trailer group, the error correction data '"J 

S^ardlTcorrecting operation performed on at least one corresponding super group of data packets. 

i data embedded within the at least one trailer group which relates said error correction data to one or more 

said con-esponding super group data packets. 
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identifiers. 

[0038] The present invention provides a novel method and system for taking an MPEG data stream generated by 
an MPEG encoder and creating an enhanced MPEG compliant data stream having optional error correction data in- 
cluded therein, such that an asymmetric decoder or end-user can process the data contained within the original MPEG 
data stream and will ignore the error correction data and assodated index data contained in the enhanced transport 
stream. However, a symmetric decoder can use the error correction to con^ct for errors in the received enhanced 
transport stream. 

Brief Description of the Drawings 

[0039] The present Invention will now be described, by way of example only, with reference to certain embodiments 
shown in the attached Figures in which: 

Figure 1 shows a schematic representation of the syntax of an MPEG-2 Transport Stream (TS) Packet; 

Figure 1a shows a schematic representation of the syntax of an adaptation field in accordance with the Transport 

Stream Packet of Figure 1; 

Figure 1 b shows a schematic representation of payload data in accordance with the Transporii Stream Packet of 
Figure 1 ; 

Figure 2 shows a schematic representation of a prior art system for fonA^ard error correcting an MPEG-2 Transport 
Stream (TS); 

Figure 3 shows a schematic representation of a system for forward error correcting an MPEG-2 Transport Stream 
(TS) in accordance with an embodiment of the present invention; 

Figure 4 shows a flowchart of a method of forward error correcting an MPEG-2 Transport Stream (TS) in accordance 
an embodiment of Figure 3; 

Figure 5 shows a schematic representation of defining a super group of transport stream packets in accordance 
with the method of Figure 3; 

Figure 6 shows a schematic representation of performing an error correction operation on parallel bytes within 
each packet of the super group in accordance with the method of Figure 4; 

Figure 7 shows a schematic representation of creating a trailer group at the end of the super group shown in Figure 
5 and in accordance with the method of Figure 4; 

Figure 8 shows a schematic representation of defining the trailer group of Figure 7 to be optional and to have no 
payload data; 

Figure 9 shows a schematic representation of embedding the error correction information shown in Figure 8 into 
the first nine transport stream packets of the trailer group shown in Figure 7, and in accordance with the method 
of Figure 4; 

Figure 10 shows a schematic representation of embedding error correction Information into the second last packet 
of the trailer group shown In Figure 7, and in accordance with the method of Figure 4; 

Figure 11 shows a schematic representation of storing index infonfnatk)n into the second last packet of the trailer 
group shown in Figure 7, and in accordance with the method of Figure 4; 

Figure 11a shows a schematic representation of storing sequence indices into the second last packet of the trailer 
group shown in Figure 7, and In accordance with the method of Figure 4; 

Figure lib shows a schematic representation of storing sequence Indices into the last packet of the trailer group 
shown in Figure 7, and in accordance with the method of Figure 4; 

Figure 12a shows a first alternative of transmitting an enhanced transport stream comprising a first super group, 
a second super group, a first trailer group and a second trailer group; 

Figure 12b shows a second alternative of transmitting an enhanced transport stream comprising a super group, 
null packets and a trailer group; and. 

Figure 13 shows a flowchart of a method of error recovery from an enhanced transport stream symmetric to the 
method of Figure 4. 

Detailed Description of the Drawings: 

[0040] Before discussing the present Invention, an MPEG-2 Transport Stream (TS) packet will be discussed briefly. 
An MPEG-2 transport stream packet (TSP) in accordance with ISO Standard 13818-1 is indicated generally at 30 in 
Figure 1 . Transport stream packet 30 is fixed in length at one-hundred-and-eighty-eight bytes and comprises a header 
section 34 and an information section 38. Header section 34 is fixed at four bytes in length and comprises a sync byte 
42, a transport error indicator bit 46, a payload start Indicator bit 50. a transport priority bit 54, a thirteen-bit Packet 
Identifier (PID) 58. two scrambling control bits 62, two adaptation field control bits 66, and four continuity counter (CC) 
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and 13818-1. ^ ^ ^ „^ „i„hh,f™ir hvtfis in lenath and comprises an adaptation 

[0042] infonnation section 38 is fixed at o"^""'!^^^ » ?2l"2S^nt2^^^ 1 ) an adaptation field 74 
eld 74 and/or payload data 78. For greaterdanty. — 

^:?^T:.TZ^^fS^:. T^T^TS^Z vanaL .en.t.s. and .avin. a 

Us90. Adapta«onfield.ength82spec^^^^^^ Jg. a random access 

field length 82. Rags 84 compnse eight "fjf p 3^ clock Reference (PCR) flag 98, an Original 

indicator flag 88, an elementary stream P™'^ '"^'^^f ^* ^ JT^I^ Transport Private Data flag 110, and an 
Program Clock Reference Base (OPCR) flag 102. a Spliang P°^1^J °f " ^j;*^"^^^^ bytes and 

Captation Field Extension flag 114. Data fle.ds 90 ^^^^^^^^^^f .^^^^^^^^ flag 84 is set 

contain several fields corresponding to their - ^^^^ , '^^Zl field (forty-two bits) 122. a Splice 

to a value of one. Data fieWs 90 compnse a PCR field (forty two brts, ^^^^^ 

countdown field (eight brts) field 136. three one^i. 

?ag\"T47orarfi:S^^^^^ '^-^ ^ ^^"^ ^^^^ " 

on Jundrad-and-eighty-fbur bytes depending on the length of dapta^on ^e d l^- ^^^^^^.^ ^^^^^ (psi) 

of contiguous data bytes of: 1) Packetized ^^l^^y^'^P^^oZ^^^^ these stLtures as indicated by 
Sections; 3) Packet Stuffing Bytes following PSI Sections, or 4) Knvaie uau. 

Packet Identifier 58. or^ri„r^rtfolwa^^erTorcorrecfionsystemwillnowbediscussed. 

[0045] Having described transport stream packet 30. a pnor ^'^^'^^^^^^^ ^ fo^ard error correction 
Lisindicatedgenerallyat200in Figure 2. Forward error coae^^^^^^^ 

encoder 204 for receiving - •-"JfS.J;^^ to a radio tower, satellite dish, cable 

outputting an error corrected data stream (ECDS) 212 to a >ransmi^^^^^ connected via a broadcast environment 
head-end or any DVB transmitter as is known in the art. ^ransmmer 216 « connert^^ ^ ^^^^^ 

218 to a complementary receK^er 220. -'^'<:^ j^^^^^^^^ 228 can be a persona. 

-ss;^^^s°.:s>raT^^^^^^^ 

[rerrLoperationofpriorartsystem 200^1. nowbediscus^w^^ 
Lari source. suchasanMPEG-2encode^createstransM^^^^^^ 

encoder 204. Forward error correction encoder 204 '"teri^^^^^^ l^en^o^ known in L art can be used . 
error correcting operation on each transport stream P^^^^'^^TueT^ enor correcting code is added to the end 
but the Reed^olomon operatton is generally the most '^'^■^^•^^ ^Tete ScPn ECP^). Together, these 
of each transport stream packet. ^^^^^^::'^"^f£S^^OOsf2^2. 
packets essentially fomi a new protocol ^^^^1'"^'^^^.^^^!^^ 2I6 which broadcasts error corrected data 
[00471 Error corrected data stream 212 is then inputted 'J*" ^-^^^^^^'^^^'^^^ data stream 212 can lose 
stream 21 2 via the broadcast environment to receiver ^^^^^l^?^^^ data stream 212 is then inputted 
information due to errors caused by 212. and uses the error cor- 

, into decoder 224 which extracts f ^P^^^f^^J^ ^l"!.^"^;^^^^^ for errors in ECPo through ECPn. The 

;2e:?r:nZrt1^^^^^^^ 

S^^'f wTr ™t -t transport stream packet ^3^;- -^^^^^ 

' bre^rrrchT^'^ 
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of forward error correcting an MPEG-2 Transport Stream (TS) in accordance with a presently preferred embodiment 
of the present invention is Indicated generally at 250 in Figure 3. Forward error correction system 250 comprises an 
enhanced forward error correction encoder 254 for receiving an MPEG-2 Transport Stream 208 from any suitable 
source such as an MPEG'2 encoder, and for outputting an enhanced transport stream (TS^) 258 to a transmitter 216 

5 such as a radio tower, satellite dish, cable head-end or any DVB transmitter as is known in the art. Transmitter 216 is 
connected via a broadcast environment 218 to a complementary receiver 220. which in tum can be connected to a 
decoder 262. Decoder 262 is symmetric to encoder 204, and outputs transport stream 208. to MPEG-2 end-user 228. 
However, because enhanced transport stream 258 is MPEG-2 compliant, receiver 220 can output enhanced transport 
stream 258 directly to MPEG-2 end-user 228, bypassing decoder 262. 

10 [0050] The operation of system 250 will now be discussed with reference to Figure 3. Transport stream 208 is received 
by forward error correction encoder 254. As will be discussed in greater detail below, encoder 254 performs a forward 
error correcting operation on parallel portions of a predefined super group of packets. Next, a predefined trailer group 
comprising a number of optional MPEG-2 compliant transport stream packets are created, and the error correcting 
code Is embedded within the private data fields 132 of the new packets. The end trailer group packets contain Identifiers 

15 or addressing information to correlate the error correcting code with the appropriate packet in the super group. As will 
be explained in greater detail below, it is presently preferred that two sequential super groups should be followed by 
their two corresponding trailer groups in the formation of a portion of enhanced transport stream 258, in order protect 
for bursty errors. In another alternative, each trailer group packet can instead t>e simply appended to the end of its 
corresponding super group, to form a portion of enhanced transport stream 258. In this latter altemative. it is contem- 

20 plated that a series of optional null transport stream packets containing stuffing bytes can be added between the super 
group and its trailer group in order to increase protection for bursty errors. The process for either alternative is repeated 
to form a continuous enhanced transport stream 258. which is then outputted to transmitter 216 
[0051] Enhanced transport stream 258 is then broadcasted by transmitter 216 via a broadcast environment 218 to 
receiver 220. During broadcast, the unreliability of the environment can cause portions of transport stream packets or 

25 entire transport stream packets within enhanced transport stream 258 to be lost. However, because enhanced transport 
stream 258 is MPEG-2 compliant, it can be passed directly to MPEG-2 end-user 228, which will ignore the optional 
trailer group and process the remaining transport stream packets according to MPEG specifications. However, en- 
hanced transport stream 258 can also be inputted into decoder 262. if present, which recovers transport stream 208 
from enhanced transport stream 258. As will be discussed in greater detail below, decoder 262 uses the error correcting 

30 code embedded within each trailer group transport stream packet, to correct for errors in TSPq through TSPj^. The 
recovered transport stream 208 is then outputted to MPEG-2 end-user 228. 

[0052] Having described system 250, the presently preferred method of fonvard error conrection as used by encoder 
254 will now be described with reference to Figures 4-12. Refening now to Figure 4. at step 300 a super group of two- 
hundred-and-forty-six transport stream packets 30 is defined. In Figure 5, step 300 is shown in greater detail, as two- 

35 hundred-and-forty-six transport stream packets (TSPq ... TSP245) are taken from transport stream 208 and formed into 
a super group 304. While it has been found that two-hundred-and-forly-six is a presently preferred number of transport 
stream packets to form super group 304, it is to be understood that other numbers of transport stream packets can be 
used to form super group 304 without departing from the scope of the invention. Considerations for the selection of 
different size super groups will be discussed in greater detail below. 

40 [0053] Referring to Figure 4, at step 350 a suitable error con-ection operation is performed on parallel bytes of each 
transport stream packet within super group 304. Referring to Figure 6, step 350 is shown in greater detail. Error cor- 
rection operation 354 is performed on parallel bytes of each transport stream packet (TSPq, TSP^. TSP2, ... TSP245) 
within super group 304. thus generating error correction packets (ECP) (ECP^. ECP2, ... ECP^e?) ^® indicated at 358. 
For greater clarity, ECP^ is derived from Byte^ of TSPq, TSP^, TSPj. through TSP245; ECP2 is derived from Byte2 of 

45 TSPq. TSP^, TSP2, through TSP245 etc. The foregoing is presently preferred in order to protect for bursty errors and 
can thus obviate the need to interteave the transport stream packets within the transport stream. However, it will be 
understood that error correction operation 354 can be performed on other parallel or non-parallel structures of super 
group 304, although it is preferred that at least one byte for processing is taken from each TS packet and no byte is 
processed twice to achieve at least some interieaving of the data. 

50 [0054] Any error correction operation known in the art can be used, but in a presently preferred embodiment. Reed 
Solomon coding is used to generate error correction packets 358 of nine bytes each. In order to reduce the size of 
error correction data, it is presently preferred to only perform error con'ection operation 354 on Byte, - Byte^sy, as ByteQ 
or Sync Byte 42 within each transport stream packet is always known to be "0x47". (As used herein, "Ox....** indicates 
a number expressed In hexadecimal format.) 

55 [0055] Referring to Figures 4 and 7, at step 400 a trailer group 404 consisting of eleven MPEG-2 compliant transport 
stream packets is created and added to super group 304. It is to be understood that eleven transport stream packets 
is particulariy suited accommodate the error correction packets 358 generated at step 350 and accordingly, trailer 
group 404 can have a fewer or greater number of packets depending on the size of super group 304 and the desired 
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15 



error correction operation 354. 404 ... TSPzse) has an adaptation 

[0056] AS shown in detail in Figure 8. each packet '^ata 78 Each trailer group 404 packet 

E fixed at one-hundred-eighty-fbur ^^^^^^^'^^Z^-^^^o. 50 and transport priority 54 all to the 
fe made optional by setting transport error ind«ator ^'.^^^^^'^^f.^^ that Packet Identifier 58 for each trailer 
:j:fof zero, in aoLrdance wrth the MPEG-2 standard rt« P^^SSe^S^ trailer group 404 wRh other Packet 
g^up 404 packet be "0x1 FFE" in order to J'"" ^rc^^^^ occurs when a trailer group 404 packet has 

rdenttfiers 58 in transport stream 208. For gf^^'^^^^f."*^-,^ „^ '^^^ The identifier is unk,ue to trailer group 404 

a common Packet Identifier 58 wKh another P^'*^' "V^^^^^^^^^ will occur, and if a collision is like^ 
packets. It is presen«y preferred thatateste»nd^cted^^^^ 

to occur, Packet Identifiers 58 in trailer group 404 are J^nged to in ^ ^^g.ste e j 

te"to1FFD-. If -0X1FFD- is likely to cause a "jJ^'^^J^^gg^g^^ scrambling control 62 .s set to 

Uh the Program Map Table in accordance t^^.^,'^.^^.^^^^^^^ stream packet has adaptation field 74 
Si^nd aiptation field control 66 is set to W to .^^^^^^^^ 

only and that no payload 78fbllows adaptation fieW 74^ ^y making tnes p ^^^^ ^28 to ignore trailer 

to be^private. they will be transparent to "[^^^ ^.^^r 22^ -unter 70 is set to a value of "bOOOO" for 
group 404. Having made the trailer group P^^^ J^on fi^d lengtt. 82 is set to a value of one-hundred-and- 

Lh bansport stream packet in J- - ^-Ts^^ toTvS" o^^ data length 128 is set to a value of one- 

P0571 At step 450 of Figure 4. error conedK>n packets 358 a ^^J^^Jf ^^^ion packets 358 into 

Up 404 transport stream packets (^St^^je JSPa«.^-^S^^^^^ 9 ,0. Because a v^o'e "u-nber of 

T<?P through TSP25S is shown in greater detail with f^^f ^nw 10 a . j^,^t^.one-byte private data field 132 
Te^^ ^'^0^00 packets 358 do^t fit ^^^ e^c. J— ^rSrec«on packets 358 between con- 
of each trailer group transport stream packet rt^ "pcP Through ECP^o and the first byte of ECP^, '"^^f^^ 
; secutive trailer group packets. For greater clanty^ eSfretTrECP^^ through ECP.o and the first two bytes of ECP,, 

. Pr^eferrin"^ to Figure 4. at step 500 f ^3^^,^^^^^^ to Figures 11-11b. Referring first to 

packet within supergroup 304. Step 500 is ^^^^^^'^^^^^^ ^et identifiera in super group 304. a tab^ 

Figure 11 . index infbrtnatton 602 compnses *l"^;„tere 620. First, each packet in super group 304 

616 of unique identifiers and indicatore 614. and ^^^"^^""^'JsBtn super group 304. "P" is then stored in pnvate 
is «^nned to detennine the number-P" of unk,ue Packet 'dent^ers 5^^^^^^^ detemnined. each of which 

,5 a3d132ofTSP,,.asindicatedat608.Next.^^^^^^^^ 

Wicates the number of bits that will be required ^" J^P^^""*^^^^^, gU is three bits in length and its value is set 
M found in super group 304 . It is presently preferred t>^.at eaj^ indiratw ^ ^^^^^ 

to (our or -bir-. Lreby indicating that '^J^^^Z^t^X ^^Z^^- ^^'^ ^"^^^ h 
of indicators 614 and their corresponding Pa*«' '^^"*f "/^^^.i^s^^ group 304 and its corresponding index 

.0 TsZ% greater clarity PID, is the first unique ^^^^^^'^^^^^^^9!^ 304 (TSPc TSP,....TSP,«) and rts 

CC , IS the first continuity counter 70 of the first transport *eem packet na g ^^^.^^ 

quential transport stream packet of super group 30^.^°"" ^.^^^jV^g Equation 2 in Appendix A. Z. the number 
JSuence ind^^s 612 require a total of X using Equation 3 in Appendix 

of^nsport stream packets whose sequence '"j^f/ '^/^^ ':373'4^"^ of two*undred-and-forty-five. for example^ 
« rrrrrofT;:^;^^^^^^^^^ ™oup 304 have the same packet — 58. and 
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Figure 11b, sequence indices 612 require a total of Y bytes, which is determined using Equation 4 in Appendix A. 
Where Y is less than one-hundred-and-eighty-one bytes, stuffing bytes 156 will be added to the end of TSP256 to fill 
the packet. It will be apparent to persons of skill in the art that where Z has a value of two-hundred-and-forty-five, Y 
will have a value of zero, and. that the formation of TSP256 is optional. 

5 [0062] It will be appreciated by persons skilled in the art that other methods of Identifying the location of packets 
within super group 304 can be performed, such as embedding a unique identifier or absolute sequence number in the 
private data fields 132 of each of the transport stream packets within super group 304. However, this method can have 
disadvantages in that it necessitates the creation of new transport stream packets that accommodate the displaced 
payload data during the process of embedding absolute sequence numbers, although the result is that the error cor- 

10 rection Information is still optional and therefore transparent to an asymmetric decoder. Another method of identifying 
the location of packets employs a combination of: embedding absolute sequence numbers in the first packet of sub- 
groups or intervals of transport stream packets within the super group, and storing sequence identifiers in the trailer 
group of the remaining packets in each subgroup, relative to the absolute sequence numbers. In this method, it is 
presentiy preferred to provide two-hundred-and-forty-six packets in each super group and six packets in each sub- 

IS group, and performing a Reed-Solomon operation which, when combined with the generated sequence identifiers, 
generates a total often packets in the trailer group. This method suffers the same disadvantage as storing absolute 
sequence numbers in each transport stream packet, as it necessitates the creation of new transport stream packets 
to accommodate displaced payload data. Other methods of identifying the location of packets within super group 304 
will occur to persons of skill in the art, and are within the scope of the present invention. 

20 [0063] It will be understood by persons of skill in the art that the inherent features of TSP256 ^ signify 
the end of super group 304. For example, simply using packet identifier 58 to identify that TSP246 through TSPjse are 
trailer group 404 transport stream packets. However, an "end trailer group" identifier, such as "OxIFIFIFFE", can be 
added to the end of the last packet (TSP256) of trailer group 404 to indicate the end of trailer group 404 to a symmetric 
decoder 262. However, the inclusion of an "end trailer group" identifier is not a cntical feature of the present invention. 

25 [0064] Steps 300 to 500 are then repeated for subsequent super groups 304 of two-hundred-and-forty-six transport 
stream packets, thereby generating a continuous enhanced transport stream 258. It is presently preferred to generate 
and send a pair of super groups 304 and then a pair of corresponding trailer groups 404 as shown in Figure 12 in order 
to protect for some types of bursty errors, however, this can be eliminated by inserting extra, optional null transport 
stream packets 412 between super group 304 and the trailer group 404, each containing only stuffing bytes 156, as 

30 shown in Figure 1 2a. It is presentiy preferred that the number of null packets 41 2 be equivalent to the maximum number 
of transport packets lost due to a bursty error. 

[0065] It will now be apparent that enhanced transport stream 258 has optional forward error correction information 
included therein, such that super group 304 can be simply transmitted directiy to MPEG-2 end-user 228. Accordingly, 
supergroup 304 (TSPq ... TSP245) can be processed by MPEG-2 end-user 228, and trailer group 354 (TSP246-TSP256) 

35 will be transparent to MPEG-2 end-user 228. Altemately, super group 304 can be transmitted to a symmetric decoder 
262 which can decode TSPq through TSP245 and utilize the error correction data contained within trailer group 404 
(TSP246...TSP256) to reassemble lost packets. As will be apparent, one of the advantages of the present invention is 
that a broadcaster of an enhanced transport stream 258 does not need to know if the receiver has a suitable decoder. 
[0066] It will be apparent from the foregoing that super group 304 can have a fewer or a greater number of transport 

40 stream packets than the presently preferred embodiment. There are three main factors that can affect the selection of 
the size of the supergroup 304. First, a super group 304 of two-hundred-and-forty-six transport stream packets allows 
the recovery of up to nine lost transport stream packets or up to four-and-a-half errored transport stream packets. This 
meets the requirements of an environment requiring a bit error ratio of 10*^ to 10~^ which is acceptable for both cable 
and satellite transmissions. A shorter super group 304 with the same length of trailer group 404 would be able to work 

45 in an environment having a higher bit error ratio, while a longer super group in an environment of a lower bit error ratio. 
Second, a super group 304 having two-hundred-and-forty-six transport stream packets has a low overhead of 4.47%. 
However, a supergroup 304 with fewer transport stream packets would have a higher percentage of overhead. Finally, 
a super group with more transport stream packets would result in increased computational complexity for the error 
correction operation. 

50 [0067] Having described an encoding method in accordance with the preferred embodiment of the present invention, 
a decoding method symmetric to the encoding method of Figure 4, and in accordance with another embodiment of the 
present invention will now be described with reference to Figure 13. At Step 700 decoder 262 takes a super group 304 
from enhanced transport stream 258, and defines an error group by examining super group 304 to determine the 
consecutive positions of any lost transport stream packets within super group 304. In the event that more than one 

55 consecutive group is located, an error group is defined for each and processed in tum. Table 616. start continuity 
counters 620 and indices 612 are first accessed from the trailer group 404 received from enhanced transport stream 
258. Using these data, Packet identifiers 58 and continuity counters 70 for each transport stream packet 30 in super 
group 304 are reconstructed and are sorted into their original order. Next, Packet Identifiers 58 and continuity counters 
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IS 



20 



meal the po!lllc«is o( lost wnspoil sMm pscKels m 5"P«' 9" P ™pail90O and the process can nnove 

swam p=cV«. »e lo«. a '"►'<«>«r?!^'''^«"I K^Tc^tST^SVo do n« match «* the* 

^^^icrs^ir^'rrr^^^Te^e^^^^^^ 

3 ^ ^ 3« W »peat^ ^ 

process. ^. . ^^^^^^h to recover all lost transport stream packets within the 

^0068] At Step 720. an enor ^^^^^^ ^^^J-^" '^^^^^^^ 354'and in the presently preferred 

error group. The error recovery operation ^^^""^^J^^^^^^^^^l^ perfomied by using corresponding error 
embodiment Reed Solomon decoding « used. The m transport stream packet are 

correction packets 358 emt)edded within trailer ^"^j'.ft^^'^^^^XZ^a^^ such errors are processed 

Duttina transport stream 208. „^^*:«r. Hota ran be aenerated and inserted into a 

foo69? >n a-ther emtK^diment of the present an asymmetric decoder 

private data field 1 32 of each transport stream paclcet S.nce p va^e g^jing to the MPEG- 
L s«ll ignore the data contained Within «.e private da^^^^^^^^^^ 
2 standard. In this emt>odiment. part of the payload of each t^^ 
packets, and thenerrorcorrectiondate^embeddedv^^^ 

stream packet. In other words, each ^"^^^^^^^'^T^ Lection information wrth the payload 

:r ^etis:™ " rt ^""^ " 

overt^ad to accommodate the adaptation field in ^^^^^^f ^-^^^IJ^^on'Sfcan be embedded wrthin other private 
[00701 in another embodiment of the present ^^^^f"' ^-^^Xte TeG-Z standard. For example, the error 
iata packets . private sections or descnptors etc. as defined ^'l^^ 'J^ ^^^^^ 53 p„gram Map Table 

^ sr:?r a«, ^^^Sbti'srs^rra. « „ ^ 

5 iiscussed herein, it will be apparent «° °* f " ^^^^^ can be utilized, as desired. For exam- 

components and/or alternative combinations ^gta streams suctvas the transport stream 

l^llT^'t^T^SX^ MPEG r r correc^n me^ and 

0 [0073] The present invention provides a r«vels|^tem and^^^^^ 

Utemtoprotectadigrtaltransport stream, by prov^an^^^^ 

forward eaor corrBction data included Video Broadcast fom,ats without the 

error correcting an MPEG2 transport -'^-"^'^^^^X l ^ J^^ This results in an error correction 
need for effectively creating another protocol ^^^^Z^^^'^^XeZ^^^ ^"^ 
iS system and method that does not require decoder ^y"™f "^"J^^^^ mpeG-2 transport stream. 

flexibility of providing an error correcting '^^'f «;:X'^;"sSenrm;i^ for forward error correction with less 
[0074] It is believed that the present invention resutts in ^JVJ^^J^JJJ'^g^ p^^kets need not be interleaved. It 
ielay than current systems and methods known in ♦•^^ J^^. as the tan^^^^^^ „p ^ four- 

is further believed that strong error recovery ,s f^^^^'^^^^^^^^^^^ also believed that the present 

^ r:trr:rrr.^"^^^^^ 

while still achieving powerful error recovery ability. 
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Appendix A 



Equation 1 

W = int (P/2 +0.5) 



Equation 2 

X = min(246x4/8, 126-2 x p^W) = inin( 123, 126-2 xP-W) 



Equation 3 



Z = 2xX-l 



Equation 4 

Y = max(0, 246 x 4/8 -( 126-2 x p-.W)) = max( 0,2 x p + W-3) 



Claims 

1 . A method of creating a portion of an enhanced l\4PEG compatible data stream with optional forward error correction 
40 information included therein, comprising the steps of: 

(i) receiving an MPEG data stream of data packets from an MPEG data stream source; 

(ii) forming a super group including a predefined number of said data packets; 

45 

(III) performing a selected fonvard error correcting operation on said super group of packets to obtain error 
correction data; 

(iv) creating index data which relates said error correction data to one or more conresponding super group 
so data packets; 

(v) creating a trailer group including a sufficient number of MPEG compliant packets to accommodate said 
error conrection data and said index data, said trailer group further including code to identify each packet as 
optional; 



(vi) arranging said error correction data and said index data into said trailer group; and 

(vii) assembling said MPEG compatible data stream with at least one super group followed by at least one 
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trailer group corresponding with said at least one super group. 
A.ett«x,oftransn,lt«ngdataasanenhanceaMPEGcon,patib.edatastre3n,w«h^^^^^^ 
information therein, comprising the steps of: 

(0 receiving an MPEG data stream of data packets from an MPEG data stream source: 

(,i) fomiing a super group including a predefined number of said data packets; 

(Hi) performing a selected fonvard enor coaecting operatU>n on said super group of packets to obtain error 

correction data; 

(iv) creating index data which relates said error correctton data to one or more corresponding super group 
data packets; 

optional; 

(vi) arranging said error correction data and said index data into said trailer group; 

(vii) assembling sak, enhanced MPEG compatible data stream with at least one super group folk,wed by at 
Lait^tile? group corresponding with said at least one super group; 

(viii) broadcasting said enhanced MPEG compatible data stream; 

(ix) receiving said enhanced MPEG compatible data stream: 

(X) extracting at .east one receded super group and at least one re^v.d ^„er group corresponding to said 
at least one received super group from said data stream recewed .n step («). and 
(xiiperfbrmlnganerrorrecove^operationonsaidatleastonereceivedsupergroupusingsak.^^ 
data in saW at least one corresponding received trader group. 
. The method according to Cairn 1 or 2. ^rein said assembly in step (vii) comprises two super groups follo^ng 
by two corresponding trailer groups. 

The method according to claim 1 or 2. wherein said assembly step (vii) comprises said super group followed by a 

predefined number of null packets and said trailer group. 
. The method according to claim 4. wherein said p^defined number is equivalent to an esfimated maximum burst 

error of the broadcast environment 
S The method acco«iing to any preceding daim. wherein said error correctk^n opera«on is perfom,ed on pa^lle. 

bytes of each packet within said super group. 

mation and indexing information included therein, comprising the steps of. 
(i) Receiving said enhanced MPEG compatible data stream; 
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8. The method according to any preceding daim, wherein said data stream is an MPEG-2 transport stream. 

9. The method according to any preceding claim, wherein said super group comprises two-hundred-and-forty-six 
data packets. 

10. The method according to any preceding claim, wherein said trailer group comprises eleven data packets. 

11. The method according to any preceding claim, wherein said error correction or error recovery operation is Reed 
Solomon coding. 

12. The method according to any preceding claim, wherein each of said packets in said super group includes a packet 
identifier and each of said packets in said trailer group includes a packet identifier different from said super group 
packet identifiers. 

IS 1 3. A portion of an enhanced MPEG compatible data stream with optional forward enx>r correction information included 
therein, comprising: 

(i) at least one super group including a predefined number of data packets; 

20 (ii) at least one trailer group including a predefined number of MPEG compliant packets, said at least one 

trailer group further including code to identify each packet as optional; 

(iii) error correction data embedded within said at least one trailer group, saki error correction data being 
obtained from a selected forward enx)r con-ecting operation performed on at least one conresponding super 

25 group of data packets; and 

(iv) index data embedded within said at least one trailer group which relates said error correction data to one 
or more said con-esponding super group data packets. 

30 14. The data stream according to claim 13. wherein said data stream is an MPEG-2 transport stream. 

15. The data stream according to claim 13 or 14, wherein said super group comprises two-hundred-and-forty-six data 
packets. 

35 16. The data stream according to any one of claims 1 3 to 1 5. wherein said trailer group comprises eleven data packets. 

17. The data stream according to any one of claims 13 to 16, wherein said fonvard error correction operation is Reed 
Solomon coding. 

^0 18. The data stream according to any one of claims 13 to 17, wherein said error correction data was generated from 
parallel bytes of each packet within said super group. 

1 9. The data stream according to any one of claims 1 3 to 1 8, wherein each of said packets in said super group includes 
a packet identifier and each of said packets in said trailer group includes a packet identifier different from said 
45 super group packet identifiers. 
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Figure 4 
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